Multi-scale Attention-Based Multiple Instance Learning for Classification of Multi-gigapixel Histology Images
نویسندگان
چکیده
Histology images with multi-gigapixel of resolution yield rich information for cancer diagnosis and prognosis. Most the time, only slide-level label is available because pixel-wise annotation labour intensive task. In this paper, we propose a deep learning pipeline classification in histology images. Using multiple instance learning, attempt to predict latent membrane protein 1 (LMP1) status nasopharyngeal carcinoma (NPC) based on haematoxylin eosin-stain (H &E) We utilised attention mechanism residual connection our aggregation layers. 3-fold cross-validation experiment, achieved average accuracy, AUC F1-score 0.936, 0.995 0.862, respectively. This method also allows us examine model interpretability by visualising scores. To best knowledge, first LMP1 NPC using learning.
منابع مشابه
Representation-Aggregation Networks for Segmentation of Multi-Gigapixel Histology Images
Convolutional Neural Network (CNN) models have become the state-of-the-art for most computer vision tasks with natural images. However, these are not best suited for multi-gigapixel resolution Whole Slide Images (WSIs) of histology slides due to large size of these images. Current approaches construct smaller patches from WSIs which results in the loss of contextual information. We propose to c...
متن کاملMulti-view metric learning for multi-instance image classification
It is critical and meaningful to make image classification since it can help human in image retrieval and recognition, object detection, etc. In this paper, three-sides efforts are made to accomplish the task. First, visual features with bag-of-words representation, not single vector, are extracted to characterize the image. To improve the performance, the idea of multi-view learning is impleme...
متن کاملLearning Instance Specific Distance for Multi-Instance Classification
Multi-Instance Learning (MIL) deals with problems where each training example is a bag, and each bag contains a set of instances. Multi-instance representation is useful in many real world applications, because it is able to capture more structural information than traditional flat single-instance representation. However, it also brings new challenges. Specifically, the distance between data ob...
متن کاملMulti-Instance Multi-Label Learning with Application to Scene Classification
In this paper, we formalize multi-instance multi-label learning, where each training example is associated with not only multiple instances but also multiple class labels. Such a problem can occur in many real-world tasks, e.g. an image usually contains multiple patches each of which can be described by a feature vector, and the image can belong to multiple categories since its semantics can be...
متن کاملAttention-based Deep Multiple Instance Learning
Multiple instance learning (MIL) is a variation of supervised learning where a single class label is assigned to a bag of instances. In this paper, we state the MIL problem as learning the Bernoulli distribution of the bag label where the bag label probability is fully parameterized by neural networks. Furthermore, we propose a neural network-based permutation-invariant aggregation operator tha...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Lecture Notes in Computer Science
سال: 2023
ISSN: ['1611-3349', '0302-9743']
DOI: https://doi.org/10.1007/978-3-031-25082-8_43